Information processing apparatus and non-transitory computer readable medium

ABSTRACT

An information processing apparatus includes a receiving unit and a controller. The receiving unit receives an extraction-area image indicating an extraction area. The extraction area includes a fill-in area in which a writer handwrites information. When an instruction to correct a recognition result for the information written in the fill-in area indicated by the extraction-area image is given, the controller causes a display unit to display a different extraction-area image similar to the extraction-area image.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based on and claims priority under 35 USC 119 fromJapanese Patent Application No. 2018-172599 filed Sep. 14, 2018.

BACKGROUND (i) Technical Field

The present disclosure relates to an information processing apparatusand a non-transitory computer readable medium.

(ii) Related Art

Recognition processing may be performed on information about characters,symbols, figures, and the like which are handwritten, and an operatormay correct the recognition results. For example, an operator maycorrect the recognition result of characters, the recognition result ofa symbol which is written in a checkbox, or the like.

Japanese Unexamined Patent Application Publication No. 6-36066 describesan apparatus modifying characters, which are included in a characterrecognition result, for each identical character category at a time.

Japanese Unexamined Patent Application Publication No. 2015-49653describes a method of controlling whether or not an area including notonly a handwritten field but also its surrounded area is to bedisplayed, on the basis of a value indicating a probability in which acharacter recognition result obtained in character recognitionprocessing is correct.

If an operator finds all of the targets for correction in order tocorrect recognition results of characters, symbols, figures, and thelike, time and effort of the operator increase.

SUMMARY

Aspects of non-limiting embodiments of the present disclosure relate toreduce time and effort of an operator compared with the case in which anoperator finds all of the correction targets in recognition results ofinformation written in fill-in areas.

Aspects of certain non-limiting embodiments of the present disclosureaddress the above advantages and/or other advantages not describedabove. However, aspects of the non-limiting embodiments are not requiredto address the advantages described above, and aspects of thenon-limiting embodiments of the present disclosure may not addressadvantages described above.

According to an aspect of the present disclosure, there is provided aninformation processing apparatus including a receiving unit and acontroller. The receiving unit receives an extraction-area imageindicating an extraction area. The extraction area includes a fill-inarea in which a writer handwrites information. When an instruction tocorrect a recognition result for the information written in the fill-inarea indicated by the extraction-area image is given, the controllercauses a display unit to display a different extraction-area imagesimilar to the extraction-area image.

BRIEF DESCRIPTION OF THE DRAWINGS

Exemplary embodiment of the present disclosure will be described indetail based on the following figures, wherein:

FIG. 1 is a diagram illustrating an information processing systemaccording to an exemplary embodiment;

FIG. 2 is a diagram illustrating an image processing apparatus accordingto the exemplary embodiment;

FIG. 3 is a diagram illustrating a terminal apparatus;

FIG. 4 is a flowchart describing operations performed by an imageprocessing apparatus;

FIG. 5 is a diagram illustrating a form;

FIG. 6 is a diagram illustrating an extraction area;

FIG. 7 is a diagram illustrating exemplary display of recognitionresults;

FIG. 8 is a diagram illustrating exemplary display of recognitionresults;

FIG. 9 is a diagram illustrating similar images;

FIG. 10 is a diagram illustrating similar images;

FIG. 11 is a diagram illustrating similar images;

FIG. 12 is a diagram illustrating exemplary display of recognitionresults; and

FIG. 13 is a diagram illustrating an extraction-area setting screen.

DETAILED DESCRIPTION

Referring to FIG. 1, an information processing system according to anexemplary embodiment of the present disclosure will be described. FIG. 1illustrates an image processing system serving as an exemplaryinformation processing system according to the exemplary embodiment.

The image processing system includes, for example, an image processingapparatus 10 serving as an exemplary information processing apparatus,and one or more terminal apparatuses 12. The image processing apparatus10 and the terminal apparatuses 12 have a function of communicating withone another through a communication path N, such as the Internet orother networks. An apparatus such as a server may be included in theimage processing system.

The image processing apparatus 10 applies recognition processing(character recognition processing and figure recognition processing) toimage data so as to recognize, for example, characters, symbols, andfigures in the image data. As the recognition processing, for example,an optical character recognition (OCR) process or an optical markrecognition (OMR) process is performed.

Image data to be recognized is not particularly limiting. For example,an image reading apparatus (for example, a scanner) may perform an imagereading process on a document, and the image data generated in the imagereading process may be used as image data that is to be recognized.Alternatively, image data obtained by an imaging apparatus (for example,a camera) capturing an image of a document may be used as image datathat is to be recognized. As a matter of course, image data generated bya method other than these may be used as image data that is to berecognized.

Each terminal apparatus 12 is, for example, a personal computer (PC), atablet PC, a smartphone, or a cellular phone. For example, informationindicating the recognition result of image data is transmitted from theimage processing apparatus 10 to a terminal apparatus 12, and therecognition result is displayed on the terminal apparatus 12.

Referring to FIG. 2, the image processing apparatus 10 will be describedin detail below. FIG. 2 illustrates the configuration of the imageprocessing apparatus 10.

An image receiving unit 14 receives image data and outputs the imagedata to a recognition processor 16. The image receiving unit 14 mayreceive image data, which is transmitted from an external apparatus, forexample, through the communication path N, or may receive image datathat is output from an image reading apparatus or an imaging apparatus.An image reading apparatus or an imaging apparatus may be included inthe image processing apparatus 10.

The recognition processor 16 applies recognition processing (characterrecognition processing and figure recognition processing) to image datareceived by the image receiving unit 14. Thus, the recognition processor16 recognizes information about characters, symbols, figures, and thelike in the image data. For example, the recognition processor 16specifies a fill-in area (for example, a fill-in field in whichcharacters are written, or a checkbox), in which it is assumed thatinformation (such as characters, a symbol, or a figure) is written, inimage data, and recognizes written information (such as characters, asymbol, or a figure) in the fill-in area. The recognition processor 16may recognize a predetermined area as a fill-in area, or may recognize,as a fill-in area, an area having a predetermined shape and size. Forexample, a writer handwrites characters, a symbol, a figure, and thelike in a fill-in area, and the recognition processor 16 recognizes thecharacters, the symbol, the figure, and the like handwritten in thefill-in area.

The recognition processor 16 extracts image data (hereinafter referredto as “extraction-area image data”), which describes the extraction areaincluding a fill-in area, from image data that is a recognition target.The recognition processor 16 associates the fill-in area with theextraction-area image data describing the extraction area including thefill-in area. An extraction area is, for example, a predetermined area.A user (for example, a person who inputs image data to the imageprocessing apparatus 10, or an operator such as a corrector who checksand corrects a recognition result) may define an extraction area. Therecognition processor 16 recognizes written information in each fill-inarea, and extracts extraction-area image data for the fill-in area. Therecognition processor 16 outputs information, indicating eachrecognition result, to a check/correction processor 20, and outputs eachpiece of extraction-area image data to a similarity determining unit 18.

The similarity determining unit 18 calculates the similarities betweenpieces of extraction-area image data extracted by the recognitionprocessor 16. In similarity calculation, for example, a known techniqueis used. For example, similarity is calculated, for example, throughfeature-value matching between images, matching using templates, orhistogram comparison between images. As a matter of course, similaritymay be calculated by using a method other than these.

The check/correction processor 20 corrects recognition results obtainedby the recognition processor 16. For example, when the check/correctionprocessor 20 receives an instruction for correction from a corrector,the check/correction processor 20 corrects recognition results inaccordance with the instruction for correction. The instruction forcorrection is given, for example, by using a terminal apparatus 12. Forexample, the check/correction processor 20 displays the image data of arecognition target and its recognition results. For example, the imagedata of a recognition target and its recognition results are displayedon a terminal apparatus 12.

The check/correction processor 20 specifies extraction-area image dataassociated with the fill-in area from which the recognition result of acorrection target is obtained, and displays, for correction,extraction-area image data similar to the specified extraction-areaimage data. For example, the check/correction processor 20 specifies, assimilar-image data, extraction-area image data whose similarity with thespecified extraction-area image data is equal to or greater than athreshold, and displays the similar-image data. The threshold for thesimilarity is, for example, a predetermined value, and may be changed,for example, by a corrector. The similar-image data is displayed, forexample, on a terminal apparatus 12. The check/correction processor 20corresponds to an exemplary receiving unit and an exemplary controller.

The check/correction processor 20 may correct the recognition resultsfor the fill-in areas included in the extraction areas indicated by thesimilar-image data, in accordance with the correction of the recognitionresult of a correction target. That is, the check/correction processor20 may correct the recognition results for the fill-in areas included inthe extraction areas indicated by the similar-image data, similarly tothe correction of the recognition result of a correction target. When acorrector gives an instruction to correct the recognition result of acorrection target, the check/correction processor 20 may correct therecognition results for the fill-in areas included in the extractionareas indicated by the similar-image data similarly (bulk correction).Alternatively, when a corrector gives the instruction for correction,the check/correction processor 20 may display the similar-image data.After that, in the case where the corrector selects pieces ofsimilar-image data that are to be corrected, and where the correctorgives an instruction to correct the selected pieces in accordance withthe correction, the check/correction processor 20 may similarly correctthe recognition results of the fill-in areas included in the extractionareas indicated by the pieces of similar-image data selected by thecorrector (selective correction).

An output unit 22 outputs information indicating the recognition resultshaving been subjected to the processing performed by thecheck/correction processor 20. The output unit 22 outputs, for example,information indicating corrected recognition results and informationindicating recognition results which have been checked withoutcorrection. For example, these types of information may be displayed ona terminal apparatus 12, or may be stored in a terminal apparatus 12, aserver, or the like.

An area setting unit 24 sets extraction areas. The recognition processor16 extracts extraction-area image data in accordance with the settingswhich are set by the area setting unit 24. The area setting unit 24 maychange the size of an extraction area in accordance with the type of afill-in area (for example, a character fill-in frame or a checkbox). Forexample, the area setting unit 24 sets, as an extraction area, an areawhich includes a fill-in area and which is larger than the fill-in area.The ratio of the size of an extraction area with respect to the size ofa fill-in area may be predetermined, or may be set by a corrector or thelike. The ratio may be changed by a corrector or the like. The areasetting unit 24 may set, as an extraction area, an area smaller than afill-in area. As a matter of course, a corrector or the like may set thesize of an extraction area to any size. For example, for a characterfill-in frame, a smaller area than the fill-in frame may be set as anextraction area.

Referring to FIG. 3, a terminal apparatus 12 will be described in detailbelow. FIG. 3 illustrates the configuration of a terminal apparatus 12.

A communication unit 26 which is a communication interface has afunction of transmitting information to other apparatuses and a functionof receiving information transmitted from other apparatuses. Thecommunication unit 26 may have a wireless communication function, or mayhave a wired communication function.

A user interface (UI) unit 28 which is a user interface includes adisplay unit and an operation unit. The display unit is a displayapparatus, such as a liquid crystal display or an electroluminescence(EL) display. The operation unit is an input device such as a keyboard.A user interface serving as a display unit and an operation unit (forexample, a touch panel) may be used as the UI unit 28. The UI unit 28may include an audio generating unit such as a speaker generating sound,and an audio input unit such as a mike receiving sound.

For example, the image data of a recognition target, informationindicating the recognition results, the extraction-area image data, andthe similar-image data are displayed on the display unit of the UI unit28. A corrector may operate the UI unit 28 to give an instruction tocorrect recognition results.

A storage unit 30 indicates one or more storage areas storing varioustypes of information (such as data and programs). The storage unit 30 isformed of one or more storage devices (for example, a hard disk driveand a memory).

A controller 32 controls operations of the units of the terminalapparatus 12. For example, the controller 32 controls communicationperformed by the communication unit 26, controls display of varioustypes of information on the UI unit 28 (the display unit), and controlsreception of information received through the UI unit 28 (the operationunit). Specifically, the controller 32 causes the display unit of the UIunit 28 to display, for example, the image data of a recognition target,information indicating the recognition results, the extraction-areaimage data, and the similar-image data.

In the example in FIG. 1, the image processing apparatus 10 and theterminal apparatuses 12 are configured separately as hardware.Alternatively, a terminal apparatus 12 may be integrated into the imageprocessing apparatus 10. That is, the image processing apparatus 10 mayhave the configuration (for example, the UI unit 28) included in aterminal apparatus 12. In this case, for example, the image data of arecognition target, and information indicating the recognition resultsmay be displayed on the display unit provided on the image processingapparatus 10. A corrector may correct recognition results by operatingthe UI unit provided on the image processing apparatus 10.

Referring to FIG. 4, operations performed by the image processingapparatus 10 will be described below. FIG. 4 is a flowchart describingthe operations.

The image data of a recognition target is input to the image processingapparatus 10, and the image receiving unit 14 receives the image data(step S01).

The recognition processor 16 specifies the fill-in areas in the imagedata, and recognizes characters, symbols, figures, and the like writtenin the fill-in areas. The recognition processor 16 further extractsextraction-area image data indicating the extraction area for eachfill-in area (step S02).

Then, the similarity determining unit 18 calculates the similaritiesbetween pieces of extraction-area image data extracted by therecognition processor 16 (step S03).

The check/correction processor 20, for example, displays the image dataof the recognition target and the recognition results (step S04). Forexample, the image data of the recognition target and informationindicating the recognition results are transmitted from the imageprocessing apparatus 10 to a terminal apparatus 12. The controller 32 ofthe terminal apparatus 12 causes the display unit of the UI unit 28 todisplay these types of information.

A corrector checks the recognition results displayed on the terminalapparatus 12. When there is a recognition result that is to becorrected, the corrector operates the terminal apparatus 12 to give aninstruction for correction. Information indicating the instruction forcorrection is transmitted from the terminal apparatus 12 to the imageprocessing apparatus 10. The check/correction processor 20 receives theinstruction for correction, and corrects the recognition result of thecorrection target in accordance with the instruction for correction(step S05).

The check/correction processor 20 specifies extraction-area image dataassociated with the fill-in area for which the recognition result of thecorrection target is obtained, and searches for similar-image data(similar-image data having a similarity, which is equal to or greaterthan the threshold, with the extraction-area image data) similar to theextraction-area image data (step S06).

If such similar-image data is found (Yes in step S07), thecheck/correction processor 20 displays the similar-image data (stepS08). For example, the similar-image data is transmitted from the imageprocessing apparatus 10 to the terminal apparatus 12, and the controller32 of the terminal apparatus 12 causes the display unit of the UI unit28 to display the similar-image data.

The check/correction processor 20 corrects the recognition results forthe fill-in areas included in the extraction areas indicated by thesimilar-image data, in accordance with the correction having beenperformed through the instruction from the corrector in step S05 (stepS09). That is, the check/correction processor 20 corrects therecognition results for the fill-in areas included in the extractionareas indicated by the similar-image data, similarly to the correctionof the recognition result of the correction target. The check/correctionprocessor 20 may correct the recognition results when the correctorgives an instruction for correction, or may correct the recognitionresults automatically.

If such similar-image data has not been found (No in step S07), theprocess proceeds to step S10.

If there is a recognition result which has not been checked forcorrection (No in step S10), the process proceeds to step S04, and theprocesses after that are performed.

If all of the recognition results have been checked for correction (Yesin step S10), the output unit 22 outputs information indicating thechecked recognition results (when corrected, information indicating thecorrected recognition results) (step S11). For example, these types ofinformation may be stored or displayed in/on the terminal apparatus 12,or may be stored in an external apparatus such as a server.

The operations performed by the image processing apparatus 10 will bedescribed in more detail by taking specific examples. Hereinafter,“image data” is referred to as an “image”; “extraction-area image data”is referred to as an “extraction-area image”; and “similar-image data”is referred to as a “similar image”.

Referring to FIG. 5, the image of a recognition target will bedescribed. For example, assume that an image indicating a document(document image) is used as the image of a recognition target.Specifically, a document image indicating a form is used as the image ofa recognition target. FIG. 5 illustrates an exemplary form. A form 33 isa document for execution of a certain procedure.

In the form 33, fill-in fields in which a writer has handwritteninformation (such as characters, symbols, and figures) are formed (forexample, printed). For example, a name fill-in field 34, in which thename of Child 1 is written, a relationship fill-in field 36, in whichthe relationship with Child 1 is written, a birth-date fill-in field 38,in which the birth date of Child 1 is written, and a checkbox 40, inwhich a figure (for example, a checkmark) about the address is written,are formed in the form 33 in advance. For Child 2, a name fill-in field42, a relationship fill-in field 44, a birth-date fill-in field 46, anda checkbox 48 are similarly formed in the form 33 in advance. The sameis true for Children 3, 4, so on. These fill-in fields and checkboxescorrespond to exemplary fill-in areas.

In the example in FIG. 5, for Children 1 to 4, a writer has handwrittencharacters indicating the names of the children, characters indicatingthe relationships, and characters indicating the birth dates in the namefill-in fields, the relationship fill-in fields, and the birth-datefill-in fields, respectively.

For Child 1, a checkmark 54 has been written so as to extend out of thecheckbox 40. That is, a portion of the checkmark 54 is written insidethe checkbox 40, and the other portion is written outside the checkbox40. The same is true for a checkmark 56 written in the checkbox 48 forChild 2, and a checkmark 58 written in a checkbox 52 for Child 4. Thecheckbox 50 for Child 3 has not been checked.

For example, the form is read by using an image reading apparatus (forexample, a scanner). Thus, the image indicating the form 33 (hereinafterreferred to as the “form image”) is generated. The form may be imaged byusing an imaging apparatus (for example, a camera). Thus, a form imagemay be generated.

The form image which is input to the image processing apparatus 10 isreceived by the image receiving unit 14 so that recognition processingis performed.

For example, the recognition processor 16 applies character recognitionprocessing to the fill-in fields indicated by the form image, thusrecognizing the characters in the fill-in fields. The recognitionprocessor 16 applies figure recognition processing to the checkboxes,thus recognizing the figures (checkmarks) written in the checkboxes. Forexample, fill-in fields such as name fill-in fields and checkboxes arespecified by a person who inputs an image, a corrector, or the like inadvance as fill-in areas that are to be recognized. The recognitionprocessor 16 performs recognition processing on the input fields and thecheckboxes which are thus specified.

As a matter of course, the recognition processor 16 may recognizecharacters, figures, and the like by using a known recognition techniqueother than the above-described recognition technique. For example, therecognition processor 16 recognizes a rectangular area (such as arectangular or square area surrounded by a straight-line frame border)in the form image, as a fill-in field or a checkbox. The recognitionprocessor 16 recognizes characters or a figure written in the fill-infield or the checkbox. For example, the name fill-in field 34, thecheckbox 40, and the like have a rectangular area. The recognitionprocessor 16 recognizes the characters written in the name fill-in field34, and recognizes a checkmark written in the checkbox 40. The same istrue for other name fill-in fields, checkboxes, and the like. As amatter of course, the recognition processor 16 may recognize an areahaving a shape other than a rectangle (for example, an area having acircular shape or an elliptic shape, or an area surrounded byparentheses) as a fill-in area. Then, the recognition processor 16 mayrecognize characters, a figure, and the like written in the area. Inaddition, the position (coordinates) of each of the fill-in fields andthe checkboxes in the form image may be predetermined. In this case, therecognition processor 16 specifies the position of each of the fill-infields and the checkboxes in the form image on the basis of thecoordinates of the fill-in field or checkbox, and recognizes characters,a figure, and the like written in the fill-in field or checkbox.

From the form image, the recognition processor 16 extracts, for eachfill-in field, an extraction-area image indicating the extraction areaincluding the fill-in field, and extracts, for each checkbox, anextraction-area image indicating the extraction area including thecheckbox.

Referring to FIG. 6, the extraction area for the checkbox 40 will bedescribed. FIG. 6 illustrates an exemplary extraction area. Anextraction area 60 is an area that is set for the checkbox 40, andincludes the checkbox 40 and its surrounding area. For example, an arealarger than the checkbox 40 by about several to several tens percent isset as the extraction area 60. The extraction area 60 may be an areahaving a shape similar to that of the checkbox 40, or may be an areahaving a shape different from that of the checkbox 40. The size andshape of the extraction area 60 may be predetermined or may be definedby a corrector or the like. For example, when it is assumed thatcharacters, figures, and the like may be written so as to extend out ofa fill-in area, an extraction area is set so as to include an area inwhich the characters, the figures, and the like may be written outsidethe fill-in area.

When the extraction area 60 is set as an extraction area for thecheckbox 40, the recognition processor 16 extracts the image indicatingthe extraction area 60 from the form image as an extraction-area image.In the example in FIG. 6, the checkbox 40 and the checkmark 54 areillustrated in the extraction area 60. Thus, the recognition processor16 extracts the extraction-area image indicating the checkbox 40 and thecheckmark 54 from the form image.

For the name fill-in field 34, the relationship fill-in field 36, andthe like, the recognition processor 16 extracts extraction-area imagesfrom the form image similarly to the extraction area 60.

The similarity determining unit 18 calculates the similarities betweenthe extraction-area images extracted by the recognition processor 16.For example, the similarity determining unit 18 calculates thesimilarities between the extraction-area image indicating the checkbox40 and the checkmark 54, and other extraction-area images (for example,the extraction-area image, which indicates the checkbox 48 and thecheckmark 56, and the extraction-area images for the name fill-infields). The same is true for extraction-area images for othercheckboxes, name fill-in fields, relationship fill-in fields, andbirth-date fill-in fields.

Recognition processing is performed as described above. Then, therecognition results are displayed on a terminal apparatus 12. Referringto FIG. 7, exemplary display of recognition results will be describedbelow. FIG. 7 illustrates an exemplary screen in which recognitionresults are displayed.

Recognition results are displayed on a screen 62. For example,information about the screen 62 is transmitted from the image processingapparatus 10 to a terminal apparatus 12, and the screen 62 is displayedon the UI unit 28 of the terminal apparatus 12.

In the example in FIG. 7, a form image 64 indicating the form 33 and adisplay field 66 for recognition results are displayed in the screen 62.In the display field 66, pairs of an image in the form image 64, whichhas been subjected to recognition processing, (for example, a scan imagegenerated through scanning) and information indicating the result of therecognition processing on the image are displayed.

An image 68 indicates the name fill-in field 34, and illustrates thecharacters themselves handwritten in the name fill-in field 34. As theimage 68, the extraction-area image indicating the name fill-in field 34and its surrounding area may be displayed. A recognition result 70 is arecognition result obtained through character recognition processing onthe name fill-in field 34. In this example, a string (for example, astring, “Minato Fuji”) is displayed as the recognition result 70.

An image 72 is an image indicating the checkbox 40 and its surroundingarea, and is an image indicating a checkmark itself handwritten in thecheckbox 40 and its surrounding area. In this example, a checkmarkitself handwritten so as to extend out of the checkbox 40 is displayed.As the image 72, an extraction-area image indicating the checkbox 40 andits surrounding area (an image indicating the extraction area 60 in FIG.6) may be displayed. A recognition result 74 is a recognition resultobtained through figure recognition processing on the checkbox 40. Inthis example, a checkmark is written so as to extend out of the checkbox40. The ratio of the area of a portion of the checkmark written insidethe checkbox 40 does not reach the ratio of the area that is largeenough to recognize, as a checkmark, a figure written in the checkbox40. Therefore, it is recognized that no checkmarks are written in thecheckbox 40 (it is recognized that the check is off), and a blankcheckbox is displayed as the recognition result 74.

Similarly, for other fill-in fields, checkboxes, and the like, theimages and their recognition results are displayed.

As described above, regardless of a checkmark which has been actuallywritten in the checkbox 40, it may be recognized that a checkmark is notwritten depending on the position at which the checkmark is written. Forexample, due to peculiarities in a writer's writing, it may berecognized that a checkmark is not written.

When a fold line is formed on the form 33, the fold line may beerroneously recognized as a line. For example, when a fold line isformed so as to extend through a checkbox, regardless of the checkbox inwhich a checkmark is not written, the fold line may be recognized as acheckmark, and it may be erroneously recognized that a checkmark iswritten in the checkbox. The same is true, for example, for a fill-infield for inputting characters. Thus, due to peculiarities of a writeror the state of the form 33 (for example, a fold line or attachment ofdust), characters, symbols, figures, and the like may be erroneouslyrecognized.

A corrector may operate the UI unit 28 of the terminal apparatus 12 tocorrect recognition results on the screen 62. For example, the correctormay correct a string serving as a recognition result, or may add acheckmark to a blank checkbox which is a recognition result. Inaddition, the corrector may delete a checkmark from a checkbox for whichthe checkmark is recognized. When the corrector gives an instruction forcorrection, information indicating the instruction for correction istransmitted from the terminal apparatus 12 to the image processingapparatus 10. The check/correction processor 20 corrects the recognitionresults in accordance with the instruction for correction.

For example, when a corrector adds a checkmark to the blank checkboxdisplayed as the recognition result 74 on the screen 62, thecheck/correction processor 20 corrects the recognition result, whichdescribes whether or not a checkmark is present for the checkbox 40,from “no checkmark” (the check is off) to “check-marked” (the check ison). FIG. 8 illustrates the result of the correction. The corrector addsa checkmark to the checkbox displayed as the recognition result 74.Thus, the check/correction processor 20 corrects the recognition result,which describes whether or not a checkmark is present for the checkbox40, from “no checkmark” to “check-marked”.

The check/correction processor 20 searches for images similar to theextraction-area image (the image indicating the extraction area 60 inFIG. 6) associated with the checkbox 40 for which the recognition result74 which is a correction target has been obtained. The check/correctionprocessor 20 corrects the recognition results for the fill-in areas (forexample, checkboxes) included in the extraction areas indicated by thesimilar images, in a similar way to the correction for the recognitionresult 74 which is a correction target (bulk correction). That is, whenan instruction to correct the recognition result 74 which is acorrection target is given, the recognition results for the fill-inareas associated with similar images are corrected at a time.

For example, assume that the extraction-area image associated with thecheckbox 48 (the image indicating the checkbox 48 and its surroundingarea) and the extraction-area image associated with the checkbox 52 (theimage indicating the checkbox 52 and its surrounding area) are similarto the extraction-area image associated with the checkbox 40. That is,the similarity between the extraction-area image associated with thecheckbox 48 and the extraction-area image associated with the checkbox40 is equal to or greater than the threshold, and the similarity betweenthe extraction-area image associated with the checkbox 52 and theextraction-area image associated with the checkbox 40 is equal to orgreater than the threshold. The extraction-area image associated withthe checkbox 48 indicates the checkbox 48 and the checkmark 56 having aportion written outside the checkbox 48. The extraction-area imageassociated with the checkbox 52 indicates the checkbox 52 and thecheckmark 58 having a portion written outside the checkbox 52.

In this case, the check/correction processor 20 corrects the recognitionresults, which describe whether or not corresponding checkmarks arepresent for the checkboxes 48 and 52, similarly to the correction forthe checkbox 40 which is a correction target (bulk correction). Forexample, when no checkmarks are recognized for the checkboxes 48 and 52(when the check is off), the check/correction processor 20 corrects therecognition results, which describe whether or not correspondingcheckmarks are present for the checkboxes 48 and 52, from “no checkmark”to “check-marked” (bulk correction).

For example, when a corrector corrects the recognition result for thecheckbox 40, the check/correction processor 20 may correct therecognition results for the checkboxes 48 and 52 in response to theinstruction for correction. Alternatively, when, in addition to aninstruction to correct the recognition result for the checkbox 40, acorrector gives an instruction to correct the recognition results forthe checkboxes 48 and 52 in accordance with the correction for thecheckbox 40, the check/correction processor 20 may correct therecognition results for the checkboxes 48 and 52.

The check/correction processor 20 may change the display of the formimage 64 in accordance with the correction results. For example, thecheck/correction processor 20 displays, in an emphasized manner, awritten image indicating characters, a figure, and the like which arewritten in a fill-in area for which correction has been performed in theform image 64 (for example, highlighted display, or display with a color(for example, red) different from that of other parts). In this case,the check/correction processor 20 may display, in an emphasized manner,a written image indicating characters, a figure, and the like written ina fill-in area which is associated with a similar image and for whichthe recognition result has been corrected in accordance with thecorrection. For example, the same correction as that for the checkbox 40has been performed on the checkboxes 48 and 52. Therefore, in theexample in FIG. 8, the check/correction processor 20 displays, in anemphasized manner, a checkmark image 76 indicating the checkmark 56 anda checkmark image 78 indicating the checkmark 58. The checkmark images76 and 78 are exemplary written images. For example, thecheck/correction processor 20 calculates the difference between a formimage, which is obtained before characters, a figure, and the like arewritten, and a form image obtained after the writing is performed. Thus,the check/correction processor 20 extracts the written characters,figures, and the like. Then, the check/correction processor 20 displays,in an emphasized manner, the written image indicating the correctedcharacters and the like. The check/correction processor 20 may display,in an emphasized manner, the checkmark image indicating the correctedcheckmark 54.

As described above, when a corrector corrects the recognition result ofa correction target, the recognition results for the fill-in areasassociated with similar images are also corrected similarly. Therefore,compared with the case in which a corrector manually searches forsimilar images, time and effort of the corrector are reduced.

The check/correction processor 20 may display similar images. Forexample, when a corrector gives an instruction to correct a recognitionresult on the screen 62, the check/correction processor 20 searches forimages similar to the extraction-area image associated with the fill-inarea from which the corrected recognition result is obtained, anddisplays the similar images.

A specific example will be described. When a corrector adds a checkmarkto the blank checkbox displayed as the recognition result 74 on thescreen 62, the check/correction processor 20 displays images similar tothe extraction-area image (the image indicating the extraction area 60in FIG. 6) associated with the checkbox 40.

Referring to FIG. 9, exemplary display of similar images will bedescribed. FIG. 9 illustrates an exemplary display area (display window)of similar images. In a display window 80, images similar to theextraction-area image associated with the checkbox 40 are displayed.Information about the display window 80 is transmitted from the imageprocessing apparatus 10 to the terminal apparatus 12, and the displaywindow 80 is displayed on the UI unit 28 of the terminal apparatus 12.In a state in which the screen 62 is displayed on the UI unit 28, thedisplay window 80 may be displayed as a pop-up window. For example, whena corrector adds a checkmark to the blank checkbox displayed as therecognition result 74 on the screen 62 (that is, when an instruction tocorrect the recognition result 74 is given), the check/correctionprocessor 20 causes the UI unit 28 to display the display window 80.Information indicating the similarities with the extraction-area imageassociated with the checkbox 40 is displayed in association with therespective similar images.

For example, extraction-area images 82, 84, and 86 are displayed assimilar images in the display window 80. The similarities between theextraction-area image associated with the checkbox 40 and theextraction-area images 82, 84, and 86 are 90%, 85%, and 50%,respectively. An image having a higher similarity indicates an imagewhich is more similar to the extraction-area image associated with thecheckbox 40. The check/correction processor 20 may display theextraction-area images in order of similarity. In the example in FIG. 9,an extraction-area image having a higher similarity is displayed at anupper position.

Assume that, for example, the extraction-area image 82 is an imageindicating the checkbox 48 and its surrounding area (the checkmark 56);the extraction-area image 84 is an image indicating the checkbox 52 andits surrounding area (the checkmark 58); the extraction-area image 86 isan image indicating the checkbox 50 and its surrounding area. Inaddition, assume that no checkmarks are recognized for the checkboxes48, 50, and 52.

A corrector operates a terminal apparatus 12 to select, from theextraction-area images 82, 84, and 86, extraction-area images that areto be corrected in accordance with the correction and give aninstruction for correction (for example, the corrector presses the OKbutton). At that time, the check/correction processor 20 corrects therecognition results for the checkboxes associated with the selectedextraction-area images, in accordance with the correction of therecognition result 74 for the checkbox 40. That is, the check/correctionprocessor 20 corrects the recognition results, which describe whether ornot checkmarks are present for the checkboxes associated with theselected extraction-area images, from “no checkmark” to “check-marked”.For example, when a corrector selects the extraction-area images 82 and84 as correction targets and gives an instruction for correction, thecheck/correction processor 20 corrects the recognition result, whichdescribes whether or not a checkmark is present for the checkbox 48associated with the extraction-area image 82, from “no checkmark” to“check-marked”. The same is true for the recognition result for thecheckbox 52 associated with the extraction-area image 84.

In the above-described example, the recognition result for a checkbox iscorrected. The case of a fill-in field (for example, a name fill-infield or a birth-date fill-in field) in which characters are written issimilar to the above-described case. When the recognition result for acertain fill-in field is corrected, similar images are displayed. Inaddition, the recognition results for the fill-in fields associated withthe similar images may be corrected at a time.

As described above, when a corrector gives an instruction to correct arecognition result that is a correction target, similar images aredisplayed. Therefore, compared with the case in which a correctormanually searches for similar images, time and effort of the correctorare reduced.

In the above-described example, the check/correction processor 20searches the same document image (form image) for similar images.Alternatively, the check/correction processor 20 may search otherdocument images for similar images. For example, the check/correctionprocessor 20 may search, for similar images, different document imagesindicating different documents in which the same writer has writtencharacters and the like, or may search, for similar images, documentimages indicating documents of the same type.

For example, the image receiving unit 14 receives a document image, typeinformation indicating the type of the document indicated by thedocument image, and writer identification information for identifying awriter who has written characters and the like in the document. Thedocument image, the type information, and the writer identificationinformation are stored in association with one another in a storagedevice (not illustrated). The storage device may be provided for theimage processing apparatus 10, or may be provided for an externalapparatus such as a server. Every time the image receiving unit 14receives a document image, its type information, and its writeridentification information, the image receiving unit 14 causes thestorage device to store the document image, the type information, andthe writer identification information in association with one another.Examples of the document type include a form for executing a certainprocedure, a report, a document for round robin approval, a writtenstatement, a minute, and a document for announcement. The writeridentification information is, for example, information indicating thename, the identification (ID), and the like of a writer. For example, awriter or a different operator uses a terminal apparatus (notillustrated) to input type information and writer identificationinformation. The image receiving unit 14 receives the type informationand the writer identification information. As a matter of course, adocument image may be associated with type information and writeridentification information in advance. Association between a documentimage and writer identification information is utilized to specify adocument image indicating a document written by the same writer. Inaddition, association between a document image and type information isutilized to specify a document image indicating a document of the sametype. A document image may be associated with both its type informationand its writer identification information, or may be associated with oneof its type information and its writer identification information.

Referring to FIG. 10, a process of searching, for similar images,document images indicating documents of the same type will be described.FIG. 10 illustrates an exemplary display window for similar images. Forexample, when a corrector adds a checkmark to the blank checkboxdisplayed as the recognition result 74 on the screen 62 illustrated inFIG. 7 (that is, when the recognition result 74 is corrected), thecheck/correction processor 20 causes the UI unit 28 to display a displaywindow 88. In the display window 88, images similar to theextraction-area image associated with the checkbox 40 are displayed.Information about the display window 88 is transmitted from the imageprocessing apparatus 10 to the terminal apparatus 12, and the displaywindow 88 is displayed on the UI unit 28 of the terminal apparatus 12.In the state in which the screen 62 is displayed on the UI unit 28, thedisplay window 88 may be displayed as a pop-up window. Informationindicating the similarities with the extraction-area image associatedwith the checkbox 40 are displayed in association with the respectivesimilar images.

For example, extraction-area images 90, 92, and 94 are displayed assimilar images in the display window 88. The similarities between theextraction-area image association with the checkbox 40 and theextraction-area images 90, 92, and 94 are 90%, 85%, and 50%,respectively. An image having a higher similarity indicates an imagewhich is more similar to the extraction-area image associated with thecheckbox 40. The check/correction processor 20 may display theextraction-area images in order of similarity. In the example in FIG.10, an extraction-area image having a higher similarity is displayed atan upper position.

In this example, the check/correction processor 20 searches, for similarimages, form images indicating forms of the same type as that of theform 33 (the document indicated by the document image that is a checktarget). For example, the document “Form 1” is a document in which thewriter “Taro Fuji” has written characters and the like, and is adocument of the same type of that of the form 33. In this example, thedocument “Form 1” is the form 33. The extraction-area image 90 is asimilar image found in the form image indicating the document “Form 1”.The document “Form 2” is a document in which the writer “Taro Fuji” haswritten characters and the like, and is a document of the same type ofthat of the form 33. The document “Form 2” is a document different fromthe form 33. The extraction-area image 92 is a similar image found inthe form image indicating the document “Form 2”. The document “Form 3”is a document in which the writer “Hanako Fuji” has written charactersand the like, and is a document of the same type of that of the form 33.The document “Form 3” is a document different from the form 33. Theextraction-area image 94 is a similar image found in the form imageindicating the document “Form 3”. In the display window 88, sets ofinformation indicating a writer name, information indicating a formname, and a similar image which are associated with one another aredisplayed. Each of the extraction-area images 90, 92, and 94 is an imageindicating a checkbox and its surrounding area. In addition, assume thatno checkmarks are recognized for the checkboxes associated with theextraction-area images 90, 92, and 94.

When a corrector operates the terminal apparatus 12 to select, from theextraction-area images 90, 92, and 94, extraction-area images that areto be corrected in accordance with the correction, and give aninstruction for correction (for example, when the corrector presses theOK button), the check/correction processor 20 corrects the recognitionresults for the checkboxes associated with the selected extraction-areaimages, in accordance with the correction of the recognition result 74for the checkbox 40. That is, the check/correction processor 20 correctsthe recognition results, which describe whether or not checkmarks arepresent for the checkboxes associated with the selected extraction-areaimages, from “no checkmark” to “check-marked”. For example, when acorrector selects the extraction-area images 90 and 92 as correctiontargets and gives an instruction for correction, the check/correctionprocessor 20 corrects the recognition result, which describes whether ornot a checkmark is present for the checkbox associated with theextraction-area image 90, from “no checkmark” to “check-marked”. Thesame is true for the recognition result for the checkbox associated withthe extraction-area image 92.

As described above, document images indicating documents of the sametype as that of the document which is a correction target are searchedfor similar images, and the similar images are displayed. Thus, comparedwith the case in which a corrector manually searches for similar images,time and effort of the corrector are reduced. For example, tendencies oferroneous recognition may be similar in documents of the same type.Therefore, similar images found in document images indicating documentsof the same type are displayed. Thus, similar images having suchtendencies are presented to a corrector.

Referring to FIG. 11, a process of searching, for similar images,document images indicating documents in which the same writer haswritten characters and the like will be described. FIG. 11 illustratesan exemplary display window for similar images. For example, when acorrector has added a checkmark to the blank checkbox displayed as therecognition result 74 on the screen 62 illustrated in FIG. 7 (that is,the recognition result 74 has been corrected), the check/correctionprocessor 20 causes the UI unit 28 to display a display window 96. Inthe display window 96, images similar to the extraction-area imageassociated with the checkbox 40 are displayed. Information about thedisplay window 96 is transmitted from the image processing apparatus 10to the terminal apparatus 12, and the display window 96 is displayed onthe UI unit 28 of the terminal apparatus 12. In the state in which thescreen 62 is displayed on the UI unit 28, the display window 96 may bedisplayed as a pop-up window. Information indicating the similaritieswith the extraction-area image associated with the checkbox 40 isdisplayed in association with the respective similar images.

For example, extraction-area images 90, 92, and 98 are displayed assimilar images in the display window 96. The similarities between theextraction-area image associated with the checkbox 40 and theextraction-area images 90, 92, and 98 are 90%, 85%, and 50%,respectively. An image having a higher similarity is an image moresimilar to the extraction-area image associated with the checkbox 40.The check/correction processor 20 may display the extraction-area imagesin order of similarity. In the example in FIG. 11, an extraction-areaimage having a higher similarity is displayed at an upper position.

In this example, the check/correction processor 20 searches, for similarimages, form images indicating forms in which the writer “Taro Fuji”,who has written characters and the like in the form 33 (the documentindicated by a document image that is a check target), has writtencharacters and the like. For example, similarly to the example in FIG.10, the documents, “Form 1” and “Form 2”, are documents in which thewriter “Taro Fuji” has written characters and the like. The document“Written contract 1” is a document in which the writer “Taro Fuji” haswritten characters and the like. The document “Written contract 1” is adocument of a type different from that of the form 33, but is a documentin which “Taro Fuji” who has written characters and the like in the form33 has written characters and the like. The extraction-area image 98 isa similar image found in the document image (written contract image)indicating the “Written contract 1”. In the display window 96, sets ofinformation indicating a writer name, information indicating a formname, and a similar image which are associated with one another aredisplayed. Similar images may be filtered by using their writer namesand their document names. Each of the extraction-area images 90, 92, and98 is an image indicating a checkbox and its surrounding area. Assumethat no checkmarks are recognized from the checkboxes associated withthe extraction-area images 90, 92, and 98.

Similarly to the examples in FIGS. 9 and 10, when a corrector selectsextraction-area images from the extraction-area images 90, 92, and 98and gives an instruction for correction, the recognition results for thecheckboxes associated with the selected extraction-area images arecorrected in accordance with the correction on the recognition result 74for the checkbox 40.

As described above, document images indicating documents in which thesame writer has written characters and the like are searched for similarimages, and the similar images are displayed. Thus, compared with thecase in which a corrector manually searches for similar images, time andeffort of the corrector are reduced. For example, in the case of thesame writer, substantially the same erroneous recognition may occur dueto peculiarities of the writer in other document images. Therefore,similar images found in document images indicating documents in whichthe same writer has written characters and the like are displayed. Thus,similar images in which such erroneous recognition may occur arepresented to a corrector.

The check/correction processor 20 may search, for similar images,document images indicating documents which are of the same type and inwhich the same writer has written characters and the like. In this case,in the examples in FIGS. 10 and 11, the check/correction processor 20searches, for similar images, form images indicating the documents,“Form 1” and “Form 2”, in which the writer “Taro Fuji” has writtencharacters and the like. As a result, the extraction-area images 90 and92 which have been found are displayed in the display window, and theextraction-area images 94 and 98 are not displayed.

A list of the document images stored in the storage device may bedisplayed on the UI unit 28 of the terminal apparatus 12. A correctormay specify document images that are to be checked. Then, the specifieddocument images may be displayed on the UI unit 28, and the recognitionresults of the document images may be checked for correction.

The check/correction processor 20 may cause the number of similar imagesto be displayed on the screen 62. FIG. 12 illustrates exemplary displayof the case. For example, when three images similar to theextraction-area image (the image indicating the extraction area 60 inFIG. 6) associated with the checkbox 40 from which the recognitionresult 74 is obtained are found, a mark 100 indicating the number ofsimilar images is displayed on the screen 62 in association with theextraction-area image. Thus, information indicating that three similarimages have been found is presented to a corrector.

The corrector selects the mark 100 on the screen 62 (for example, whenthe corrector clicks the mark 100), the check/correction processor 20causes the UI unit 28 to display the display window 80 illustrated inFIG. 9, the display window 88 illustrated in FIG. 10, or the displaywindow 96 illustrated in FIG. 11.

Alternatively, the check/correction processor 20 may search for similarimages on the basis of the time when a document image is generated. Forexample, the check/correction processor 20 searches, for similar images,document images generated in a time predetermined on the basis of thetime when a document image which is a check target is generated. Thetime when a document image is generated is, for example, the time whenthe document is scanned so that the document image is generated, or thetime when the document is imaged. For example, when the form image 64specified as a document image to be checked is displayed on the screen62, the check/correction processor 20 searches, for similar images,document images generated in the time predetermined on the basis of thetime when the form image 64 is generated. The check/correction processor20 may search, for similar images, document images generated in thepredetermined time before the form image 64 is generated. Alternatively,the check/correction processor 20 may search, for similar images,document images generated in the predetermined time after the form image64 is generated. Alternatively, the check/correction processor 20 maysearch, for similar images, document images generated in thepredetermined times before and after the form image 64 is generated. Thecheck/correction processor 20 also searches the form image 64 forsimilar images.

The check/correction processor 20 may search, for similar images,document images which are generated in the time predetermined on thebasis of the time when the form image 64 is generated and in which thesame person as the writer who has written characters and the like in theform 33 has written characters and the like.

When a corrector gives an instruction to correct a recognition resultthat is to be corrected, the check/correction processor 20 may correctthe fill-in areas associated with the similar images in accordance withthe correction and the attribute of the fill-in areas. For example, inthe case where the fill-in areas associated with the similar imagescorrespond to fill-in areas in which it is assumed that writing is to beperformed in a single-character frame (for example, a single character,a single number, a single symbol, or a single figure), when a correctorgives an instruction to correct the recognition result that is to becorrected, the check/correction processor 20 similarly corrects therecognition results for the fill-in areas associated with the similarimages. That is, bulk correction is performed for single-characterframes. In contrast, in the case where the fill-in areas associated withthe similar images include frames other than a single-character frame,such as name fill-in fields, when a corrector gives an instruction tocorrect the recognition result that is to be corrected, as illustratedin FIG. 9 and the like, the check/correction processor 20 causes the UIunit 28 to display a display window on which the similar images aredisplayed. When a corrector gives an instruction to correct the similarimages in accordance with the correction, the check/correction processor20 similarly corrects the recognition results for the fill-in areasassociated with the similar images. Attribute information indicating theattribute of a fill-in area may be associated in advance with thedisplay position of the fill-in area in the document image. In addition,the check/correction processor 20 may assume the attribute of a fill-inarea associated with a specific string on the basis of the stringdescribed in the document image. For example, a string, such as “Yourname” or “Name”, is a string expressing the attribute “name”. Therefore,a fill-in area associated with such a string (for example, a fill-inarea disposed near such a string) has the attribute “name”. As otherattributes, the attribute “address”, the attribute “telephone number”,the attribute “ID”, and the like may be used. In addition, thecheck/correction processor 20 may assume the attribute of a fill-in areaon the basis of the size and shape of the fill-in area. For example,when the size of a fill-in area is suitable for a single character, asingle symbol, a single figure, or the like, the fill-in area isrecognized as a single-character frame.

The check/correction processor 20 may perform bulk correction on therecognition results for the fill-in areas associated with similarimages, on the basis of recognition confidence factors. A confidencefactor indicates the degree of confidence in which characters, a symbol,a figure, and the like are correctly recognized through recognitionprocessing (the degree indicating a probability in which a recognitionresult is correct). For example, the reciprocal of the distance betweenthe feature of characters extracted from a document image and thestandard feature of a recognition candidate of the characters is used asthe confidence factor. A greater confidence factor means that thefeature of extracted characters is closer to the standard feature of arecognition candidate, leading to a decrease in the probability in whichthe recognition result is erroneous. As another definition, thesimilarity between the features may be used as the confidence factor. Asa matter of course, a different definition other than these may be used.

For example, the check/correction processor 20 performs bulk correctionon the recognition results for the fill-in areas associated with similarimages whose confidence factors are less than a threshold. Thus,recognition results having high probabilities of being erroneous arecorrected at a time. As a matter of course, the check/correctionprocessor 20 may perform bulk correction on the recognition results forthe fill-in areas associated with similar images whose confidencefactors are equal to or greater than the threshold. The threshold forthe confidence factor is, for example, a predetermined value, and may bechanged by a corrector or the like.

Referring to FIG. 13, a setting screen for an extraction area will bedescribed. FIG. 13 illustrates an exemplary extraction-area settingscreen. In the extraction-area setting screen, the width and height ofan extraction area may be set by using a pixel count. As anotherexample, the width and height of an extraction area may be set by usinga ratio (%) with respect to the fill-in area. Alternatively, the widthand height of an extraction area may be set for each recognition target(such as characters, a symbol, or a figure). In this case, the width andheight of an extraction area may be changed for each recognition target.For example, the extraction-area setting screen is displayed on the UIunit 28 of a terminal apparatus 12, and a corrector sets the width andheight of an extraction area. The recognition processor 16 extracts anextraction-area image in accordance with the information which has beenset in the window.

Each of the image processing apparatus 10 and the terminal apparatuses12 which are described above is implemented, for example, in cooperationwith hardware and software. Specifically, each of the image processingapparatus 10 and the terminal apparatuses 12 includes one or moreprocessors such as a central processing unit (CPU) (not illustrated).The one or more processors read programs stored in a storage device (notillustrated) and execute the programs. Thus, the units of each of theimage processing apparatus 10 and the terminal apparatuses 12 areimplemented. The programs described above are stored in the storagedevice via a recording medium, such as a compact disc (CD) or a digitalversatile disc (DVD), or via a communication path such as a network. Asanother example, the units of each of the image processing apparatus 10and the terminal apparatuses 12 may be implemented through hardwareresources, such as a processor, an electronic circuit, or an applicationspecific integrated circuit (ASIC). A device such as a memory may beused in the implementation. Further, as another example, the units ofeach of the image processing apparatus 10 and the terminal apparatuses12 may be implemented, for example, through a digital signal processor(DSP) or a field programmable gate array (FPGA).

The foregoing description of the exemplary embodiment of the presentdisclosure has been provided for the purposes of illustration anddescription. It is not intended to be exhaustive or to limit thedisclosure to the precise forms disclosed. Obviously, many modificationsand variations will be apparent to practitioners skilled in the art. Theembodiment was chosen and described in order to best explain theprinciples of the disclosure and its practical applications, therebyenabling others skilled in the art to understand the disclosure forvarious embodiments and with the various modifications as are suited tothe particular use contemplated. It is intended that the scope of thedisclosure be defined by the following claims and their equivalents.

What is claimed is:
 1. An information processing apparatus comprising: areceiving unit that receives an extraction-area image indicating anextraction area, the extraction area including a fill-in area in which awriter handwrites information; and a controller that, when aninstruction to correct a recognition result for the information writtenin the fill-in area indicated by the extraction-area image is given,causes a display unit to display a different extraction-area imagesimilar to the extraction-area image.
 2. The information processingapparatus according to claim 1, wherein the fill-in area is an areaformed in a document, and wherein the controller searches, for thedifferent extraction-area image, images indicating a plurality ofdocuments in which the writer has written information, and causes thedisplay unit to display the different extraction-area image.
 3. Theinformation processing apparatus according to claim 1, wherein thecontroller searches a first image and a second image for the differentextraction-area image, and causes the display unit to display thedifferent extraction-area image, the first image indicating a firstdocument in which the fill-in area is formed, the second imageindicating a second document of a type identical to a type of the firstdocument.
 4. The information processing apparatus according to claim 1,wherein the controller searches a first image and a second image for thedifferent extraction-area image, and causes the display unit to displaythe different extraction-area image, the first image indicating a firstdocument in which the fill-in area is formed, the second imageindicating a second document generated in a time predetermined on abasis of a time when an image of the first document is generated.
 5. Theinformation processing apparatus according to claim 1, wherein, when theinstruction for correction is given, the controller further corrects adifferent fill-in area in accordance with the correction, the differentfill-in area being indicated by the different extraction-area image. 6.The information processing apparatus according to claim 2, wherein, whenthe instruction for correction is given, the controller further correctsa different fill-in area in accordance with the correction, thedifferent fill-in area being indicated by the different extraction-areaimage.
 7. The information processing apparatus according to claim 3,wherein, when the instruction for correction is given, the controllerfurther corrects a different fill-in area in accordance with thecorrection, the different fill-in area being indicated by the differentextraction-area image.
 8. The information processing apparatus accordingto claim 4, wherein, when the instruction for correction is given, thecontroller further corrects a different fill-in area in accordance withthe correction, the different fill-in area being indicated by thedifferent extraction-area image.
 9. The information processing apparatusaccording to claim 5, wherein the controller corrects the differentfill-in area in accordance with the correction on a basis of aconfidence factor of a recognition result for information written in thedifferent fill-in area.
 10. The information processing apparatusaccording to claim 6, wherein the controller corrects the differentfill-in area in accordance with the correction on a basis of aconfidence factor of a recognition result for information written in thedifferent fill-in area.
 11. The information processing apparatusaccording to claim 7, wherein the controller corrects the differentfill-in area in accordance with the correction on a basis of aconfidence factor of a recognition result for information written in thedifferent fill-in area.
 12. The information processing apparatusaccording to claim 8, wherein the controller corrects the differentfill-in area in accordance with the correction on a basis of aconfidence factor of a recognition result for information written in thedifferent fill-in area.
 13. The information processing apparatusaccording to claim 5, wherein, when the instruction for correction isgiven, the controller corrects the different fill-in area in accordancewith the correction on a basis of an attribute of the fill-in area. 14.The information processing apparatus according to claim 6, wherein, whenthe instruction for correction is given, the controller corrects thedifferent fill-in area in accordance with the correction on a basis ofan attribute of the fill-in area.
 15. The information processingapparatus according to claim 7, wherein, when the instruction forcorrection is given, the controller corrects the different fill-in areain accordance with the correction on a basis of an attribute of thefill-in area.
 16. The information processing apparatus according toclaim 8, wherein, when the instruction for correction is given, thecontroller corrects the different fill-in area in accordance with thecorrection on a basis of an attribute of the fill-in area.
 17. Anon-transitory computer readable medium storing a program causing acomputer to execute a process comprising: receiving an extraction-areaimage indicating an extraction area, the extraction area including afill-in area in which a writer handwrites information; and when aninstruction to correct a recognition result for the information writtenin the fill-in area indicated by the extraction-area image is given,causing a display unit to display a different extraction-area imagesimilar to the extraction-area image.
 18. An information processingapparatus comprising: means for receiving an extraction-area imageindicating an extraction area, the extraction area including a fill-inarea in which a writer handwrites information; and means for, when aninstruction to correct a recognition result for the information writtenin the fill-in area indicated by the extraction-area image is given,causing a display unit to display a different extraction-area imagesimilar to the extraction-area image.